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Abstract 

For evolutive Hamilton-Jacobi equations, we propose a refined def- 
inition of C°-variational solution, adapted to Cauchy problems for 
continuous initial data. In this weaker framework we investigate the 
Markovian (or semigroup) property for these solutions. In the case 
of p-convex Hamiltonians, when variational solutions are known to be 
identical to viscosity solutions, we verify directly the Markovian prop- 
erty by using minmax techniques. In the non-convex case, we construct 
an explicit evolutive example where minmax and viscous solutions are 
different. Provided the initial data allow for the separation of variables, 
we also detect the Markovian property for convex-concave Hamiltoni- 
ans. In this case, and for general initial data, we finally give upper and 
lower Hopf-type estimates for the variational solutions. 

1 Introduction 

The two- fold aim of this paper is to provide a refined definition of variational 
solution -sometimes called also minmax solution- to Cauchy Problems for 
Hamilton-Jacobi equations of the evolutive type, 



{CP) I 



w (t,x) + H(t,x,^(t,x)) = 



K u(0,x) = a{x), 

for the case of continuous initial data a E C°, and to discuss some aspects 
related to the Markovian property of these solutions. The problem is posed 
on a smooth, connected and closed manifold iV of dimension k (typically the 
flat torus T k ), and the Hamiltonian H is assumed to be of class C 1 ' 1 ([0, T] x 
T*N). 
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The early notion of a variational solution to (CP) has been introduced 
in the Nineties by Chaperon and Sikorav ([TT], [32] and |25j). The construc- 
tion -see Section [3]- employs a Lusternik-Schnirelman-type procedure based 
on generating functions quadratic at infinity (GFQI) for the Lagrangian 
submanifold -geometric solution- L obtained by gluing together the char- 
acteristics of the Hamiltonian vector field for 7i(t,x,r,p) = r + H(t,x,p) 
starting from the initial data submanifold 

T CT = {(0,x,-H{0,x,da{x)),da(x)) : x € N} C TT^O) C T*(R x N). 

In this smooth geometrical environment, the notion of variational solution 
-which results to be Lipschitz on finite time, see for example [11 J and [26J- 
overcomes the difficulties arising from the obstruction to existence of global 
solutions. 

However, as the very definition of T a explains, the global object L encom- 
passing geometrically the multi- valued features of the Hamilton- Jacobi prob- 
lem cannot be defined everywhere for non-differentiable functions a. Con- 
sequently, the standard procedure to obtain the related variational solution 
does not work anymore. 

Our first contribution consists in introducing a natural notion of C°- 
variational solution whose Definition 14.21 is based on a continuity argument 
inspired by Viterbo -see Theorem 14.11 - and utilizes C 1 approximating se- 
quences of a in the uniform norm. 

Extending the notion of variational solution to continuous initial data is 
crucial for the investigation of the Markovian (or semigroup) property, see 
|25j . which means that for all < t\ < ti < t% < T the following holds: 

where the map 

jtM . c o {N) ^ c o m /( . } jtM {m := u{ti 0j 

for t € [0, T] describes the C°-variational solution u(t, x) on the interval 
[0, T] starting from u(t\, ■) = /(•). Loosely speaking, this property requires 
that the solution at tz can be determined by the knowledge of the solution 
at any intermediate instant t%. 

As is well known, there is another important notion of weak solution 
for Hamilton-Jacobi equations with continuous initial data, namely, the vis- 
cosity solution. The reader is referred to [20] . [5], [3] for general review on 
the theory. Even thought variational and viscosity solutions have the same 
analytic properties, it is not known in the general non-convex case whether 
they coincide or not, although they do for p-convex Hamiltonians ([16j, [7j). 
In Section HJ] we construct an evolutive example showing explicitly the sep- 
aration between these two notions of solution for non-convex Hamiltonians. 
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A main feature of the viscosity solutions is the Markovian property, see 
|22j . This property has not been proved for variational solutions in general. 
By following early suggestions by Viterbo and Ottolenghi ([25]. [32J ) , we 
establish that if the Hamiltonian is compatible with a natural notion of 
non-hysteresis for the above operator J, the stronger group, and a fortiori 
the Markovian, property is forced on the variational solutions. Specifically, 
we prove that the C°-variational solution does not exhibit hysteresis, that 
is 

jtiM Q jt 2 ,ti^ = a (non-hysteresis) (1) 
Vti,*2 £ [0)^] an d Vcr G C°(N), if and only if the group property holds: 

jtB,t2 oJ t2,t 1 ^ = jt 3 ,t 1 ^ j ( 2 ) 

Vh,t 2 ,t 3 G [0,T] and Vcr G C°(N). 

We further investigate variational solutions for the case of p-convex 
Hamiltonians H(t,x,p) G C 2 ([0,T] x T*T k ), when, as recalled, variational 
and viscous solutions are the same and the Markovian property holds. How- 
ever, no direct proof of the latter in a variational framework was available, 
and here we prove the Markovian property for variational solutions by solely 
using minmax techniques. Our discussion is useful for generalizations to- 
wards some non-convex cases: in particular, we verify the Markovian prop- 
erty also for convex-concave Hamiltonians, provided the initial data separate 
the variables. 

Finally, for general initial data, we give upper and lower Hopf-type esti- 
mates for the variational solutions. These Hopf-type inequalities are analo- 
gous to the ones given in [4 J and [2 J in the viscous case and they similarly offer 
a representation formula for the variational solution whenever a "maxmin" 
equals to a "minmax". 

This paper is organized as follows. In Sections [2] and [3] we recall some 
facts about Lagrangian submanifolds, their generating functions and the 
construction of the variational solutions to (CP). The following section 
gives a detailed and self-contained proof of the uniform continuity of the map 
J*'* 1 and the definition of the C°-variational solution. After a brief compar- 
ison with the viscous case, we also provide an explicit evolutive example 
where variational and viscous solutions are actually different. The Marko- 
vian property and their relation to hysteretic phenomena for variational 
solutions are discussed in Section \5{ while in Section 16.11 -by utilizing exclu- 
sively minmax arguments- we prove the Markovian property for p-convex 
Hamiltonians. In Section 16.21 we identify a class of non-convex problems 
for which the Markovian property holds and present upper and lower Hopf- 
type estimates for variational solutions related to general convex-concave 
Hamiltonians. In the Appendix [7] -essentially following [H]- we explicitly 
construct the finite-parameters GFQI globally describing the geometric so- 
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lution L for Hamiltonians H G C 2 ([0,T] x T*T k ) of the form: 



H(t, x, p) = - (Ap, p) + V{t,x,p), 

V(t,x,p) compactly supported in the p variables, and show that it is essen- 
tially determined by the the quadratic form (Ap,p) involved in the Hamil- 
tonian. As is pointed out in Sections 16.11 and 16.21 this structure becomes 
crucial in the discussion of the Markovian property for variational solutions. 

2 Preliminaries 

Here we review some topics from the theory of Lagrangian submanifolds and 
their generating functions. 

Let TV be a smooth, connected and closed (i.e. compact and without 
boundary) manifold of dimension k. We consider the cotangent bundle 
T*N equipped with the canonical symplectic form uj = dp A dx, in local 
coordinates uj = Yli=i ^Pi A dx 1 . 

A Lagrangian submanifold L C T*N is a manifold of dimension k such that 
uj vanishes on L. A classical argument by Maslov and Hormander shows 
that, at least locally, every Lagrangian submanifold is described by some 
generating function of the form 

S:NxR h — ► R, (a;,£)i — >S{x,£) 

in the following way: 

where is a regular value of the map 

We observe that the intersection points of L with the zero section Ot*n 
of T*N are in one-to-one correspondence with the global critical points of 
S. Looking for a condition implying the existence of critical points, the 
following class of generating functions has been decisive in many issues. 

Definition 2.1 A generating function S : x R h -> R is quadratic at 
infinity (GFQI) if for every |£| > C > 

S(x,0 = Q(0, (3) 

where Q(£) is a nondegenerate quadratic form. 
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There are three main operations on generating functions which preserve 
the quadraticity at infinity property and leave invariant the corresponding 
Lagrangian submanifolds (see e.g. [3l], |19j): 

• Fibered diffeomorphism. Let S : N x R h -> R be a GFQI and N x R h 3 

(x, £) i-> (x, </> (x, £)) G TV x R h a map such that, Vx G iV, 

M fc 9 £ i — > (x, £) G M h 

is a diffeomorphism. Then 

S"i (x,£) := S (x,</)(x,g)) 

is quadratic at infinity and generates the same Lagrangian submanifold of 
S. 

• Stabilization. Let S : N x R h -> R be a GFQI Then 

5! (x.e.T/) :=5(x,e)+S(??), 

where 77 G R l and is a nondegenerate quadratic form, generates the 

same Lagrangian submanifold of S. 

• Addition of a constant. Finally, as a third -although trivial- invariant 
operation, we observe that by adding to a generating function S an arbitrary 
constant c£K the described Lagrangian submanifold is invariant. 

Crucial problems in the global theory of Lagrangian submanifolds and 
their parameterizations are i) the existence of a GFQI for a Lagrangian 
submanifold L C T*N, ii) the uniqueness of it (up to the three operations 
described above). 

The following theorem -see [27] and [21] _ answers to the first question. 

Theorem 2.2 ( Chaperon- Chekanov-Laudenbach-Sikorav) Let Ot*n be the 
zero section ofT*N and (</>t)te[oi] a Hamiltonian isotopy. Then the La- 
grangian submanifold <j)\ (Ot*n) admits a GFQI 

The answer to the second problem is due to Viterbo [33J: 

Theorem 2.3 (Viterbo) Let Ot*n be the zero section ofT*N and (<i>t)te[o 1] 
a Hamiltonian isotopy. Then the Lagrangian submanifold (pi (Ot*n) admits 
a unique -that is, up to the above operations- GFQI 

Previous theorems -see |30j and [29] - remain true when the isotopy is only 
symplectic and we consider generating forms instead of functions. 

We resume now the Lusternik-Schnirelman calculus of critical values for 
a GFQI S(x;£). Let us consider the sublevel sets 

S c :={(x;0- S(x;0<c}, Q c := : Q (£) < c} . 
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We denote by the positive and negative eigenspaces of Q, large discs 
in and dD^ their boundary. 

Since for c > large enough S ±c = N x Q ±c , we have 

H*(S C , S-°) = H* (N x Q c , JV x Q- c ) 

= H*{N)®H*(Q C ,Q- C ) = H*{N)®H*{D-,dD-). (4) 

Thus, if p is the generator of H* (D~ , dD~), to each cohomology class a G 
H*(N) corresponds the image Ta G H*(S C , S~ c ) by the Thorn isomorphism: 

H*(N) 9 a i— > Ta = a A p G F*(S C , 5^ c ). 

Let now 

^ : H*(S C ,S~ C ) -» H*(S X ,S- C ) 
be the pull-back of the inclusion i\ : S x ^ S c . 

The idea of utilizing forms in order to construct critical values of <S comes 
back to Birkhoff and Morse. 

Theorem 2.4 (Minmax theorem) For 0/a £ H*(N), the minmax value 
c(a, S) defined as 

c(a, 5) := inf{A € [-c, +c] : i^Ta ^ °}> ( 5 ) 
is a critical value of S. 

It is now proved in [31] that -up to a global shift- c(a, S 1 ) depends only on 
L, not on 5, and it is thus denoted by c(a, L). 

We finally recall the definition and properties of the symplectic invariant 
7 for Hamiltonian diffeomorphisms. The presentation of this matter is here 
oriented to introduce the main tools in order to give a self-contained proof 
of the forthcoming Theorem 14. 1[ We refer to [31] , [TO] , p3] and [15] for an 
exhaustive treatment of the subject. 

Let C be the set of Lagrangian submanifolds of T*N which are Hamiltonian 
isotopic to Ot*n and L\ y Li G C be generated by the GFQI Si(x\g) and 
Si(x;rj) respectively. We denote by (Si S2)(x; £, rj) the GFQI 

(Si tt 5 , 2 )(a;; £, rj) = S x (x; g) + S 2 (x; rj), 

and we define 

7(L X , L 2 ) :=c(m,5i ft (-5 2 )) - c(l, 5i (1 S 2 ), (6) 

where 1 G #°(iV) and G H k (N) are generators. We remind that the value 
j(Li, L 2 ) is often denoted, with abuse of language, by j(Li — L 2 ). 
The previous definition of 7(Li,L 2 ) pushes to consider the following sym- 
plectic invariant for Hamiltonian diffeomorphisms. 
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Definition 2.5 Let ((f>t)te[o,i\ be a Hamiltonian isotopy, = <j)\. We set 

7 (0) :=sup{ 7 (0(L),L) :LG£}. (7) 

All the Hamiltonians are now assumed to be compactly supported, as in 
|31j . We refer to [TO] for the proof of the following results. 

Proposition 2.6 For the function 7 the following properties hold: 

1- 7(0) > and 7(0) = if and only if 4> = id, 

2. 7 (0) =7(0-!), 

5. 7(0o0;) < 7(0) + 7("0) (triangle inequality), 

4- 7("0 o o i/; -1 ) = 7(0) (invariance by conjugation). 

In particular, d{(p\,4>2) '■= 7(02 1 0i) defines a metric on the group of 
Hamiltonian diffeomorphisms ofT*N. 

Proposition 2.7 Assume that is the time- one map associated to the 
Hamiltonian H(t,x,p). Then we have 

7(0) < \\ H \\ c o- 

We notice that the uniform norm of the Hamiltonian is defined up to the 
addition of a constant, that is: 

||i?||c° := SU P H(t,x,p)— inf H(t,x,p). 

[0,T]xT*N [0,T]xT*N 

3 Construction of the variational solution 

In the sequel, the above topics based on a smooth, connected and closed 
manifold A will be utilized for a space-time manifold [0, T] x A of dimen- 
sion k + 1. 

Let consider the following Cauchy problem, related to an evolutive Hamilton- 
Jacobi equation: 

'%(t,x) + H(t,x,%(t,x)) = 

(8) 

k ii(0, x) = a(x) 

We suppose the Hamiltonian H : R x T*N — > R of class C ' and the initial 
condition <r : A — > R of class C 1 . 

Let R x A be the "space-time" , T* (R x N) its cotangent bundle (endowed 
with the standard symplectic form dp A dx + dr A dt) : 

T* (R x A) = {(t,x,T,p)} ^ K x A = {(t,x)}, 



7 



and TC (t, x,r,p) = r + H (t, x,p). 

We start resuming the standard procedure to obtain the so-called geomet- 
ric solution to the Cauchy problem ([8]), which is a Lagrangian submanifold 
L C T*N attaining -in the sense explained below- the initial condition a 
and satisfying: 

L c H' 1 (0) . 

Let <S> t : E x T* (E x N) -> T* (E x AT) be the flow generated by the Hamil- 
tonian W : T* (E x TV) — > E and r CT the initial data submanifold: 

F a := {(0, x, -H (0, x, do- (z)) , dtr (a;)) : xGiVjcr 1 (0) C T* (E x A 7 ") . 

(9) 

We note that is the intersection of the Lagrangian submanifold A a = 
{(0, x, t, da (x)) : x € N, r G E} with the hypersurface TL~ l (0): 

v a = K n ?r 1 (o) . (io) 

Definition 3.1 The geometric solution to (f5| is the submanifold L = L a : 
L:= \J $ t (r CT ) C T* (E x AT) . (11) 

0<t<T 

For the following result we refer to [33], [8] and [7j. 

Proposition 3.2 The geometric solution L is an exact Lagrangian subman- 
ifold, contained into the hypersurface TL -1 (0) and Hamiltonian isotopic to 
the zero section Ct*([o,t]xAT) of T* ([0, T] x N). 

As a consequence of the previous Proposition 13.21 Theorem 12.31 guarantees 
that the Lagrangian submanifold L admits essentially (that is, up to the 
three operations described above) an unique GFQI 

S : ([0, T]xJV)xK^ E, (t, x;£)^S (t, x; f ) . 

Moreover, we can assume that the graph of S (t, x; £) at t = coincides with 

r CT : 

r ff = Ln7r [ - 1 21xAr ({0}xJV) 
[ ( as , as , \ as , ^ 1 

= ^Q, x , — (0, x -Z), — (0, x -Z)) : _(0 )a! ;O=0j. 

The quadraticity at infinity property is crucial: as explained here below, 
variational solutions arise from the application of the Lusternik-Schnirelman 
method to S (t, x; £). 

We denote by S(t tX -)(£) = S(t,x;£) the restriction of S to the fiber over 
(t, x) and we look for a minmax value of the function S^ t x y Since the 
cohomology of the point is one dimensional, denoting by l(t, x ) hs generator, 
we give the following 
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Definition 3.3 The variational solution of is the function -see 

(t,x) i * u(t,x) := c(l( tia .),5( t)!C )). (12) 

The next fundamental theorem has been proved by Chaperon in [TT], see 
also |25j . A simple and self-contained proof of the Lipschitzianity of u(t,x) 
is also given in [26j . 

Theorem 3.4 The variational solution u(t,x) is a weak solution to (CP), 
Lipschitz on finite time, which does not depend on the choice of the GFQI 
S(t,x;0- 

We observe that the definition of variational solution arises naturally in 
the compact case, when the Theorem 12.31 is satisfied. Moreover, since 
H*(D-,dD~) = H*(Q C ,Q- C ) (see ®), for any point (t,x) e [0,T] x N, 
the minmax critical value u(t,x) is determined by the Morse index of the 
quadratic form Q(£) coinciding with S(t, x;£) out of a compact set in the 
parameters £. As it is largely known, for p-convex Hamiltonians -we refer 
to [TE] and [7] for details- the Morse index of the quadratic form Q(£) is 0. 
Then 

u(t,x) = min SCt,x]tj). (13) 

Analogously, recalling that c(n,S) = —c(l,—S) (see [31]), the p-concave 
case gives: 

u(t, x) = — min —S(t, x;tj) = maxfiYi, X]£). (14) 

A rather general discussion for Hamiltonians of the form H(t, x,p) = ^(Ap,p} + 
V(t,x,p) is performed in the Appendix. The previous representation for- 
mulas (fTBT) and ([14]) will be crucial in Section [H which is devoted to the 
discussion of the Markovian property for variational solutions in the convex 
and convex-concave cases. 

We conclude with the following result, see [2], showing the 7-continuity of 
the variational solution with respect to the geometric one. 

Proposition 3.5 Let L\,L2 and u\,U2 be the geometric and variational 
solutions for the Cauchy problems referred to the initial data o\ and 02 
respectively. Then we have 

IK - -"2||a° < 7(^1,^2)- 
4 C°- variational solutions and viscosity solutions 

In the previous section, given a pair (H,a) G C^QO, T] x T*N) x C^iV), 
we have outlined the construction of the geometric solution L (see (jlip ) and 
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the variational solution u (see (I12D ). which results (Theorem 13. 4p Lipschitz 
on finite time. Thus we consider the application J: 

J : C 1,:L ([0,r] x T*N) x C\N) -> C 0,1 ([0,T] x AT) 

{H,cr)^u=: J(H,a) (15) 

associating to the pair {H, a) the variational solution to the Cauchy problem 
([8j). Often in the following we refer to the above solution as to the C 0,1 - 
variational solution. 

The very construction of u enables us to establish the next main result 
outlined by Viterbo in [25] and [33]. Here below, we focus on a detailed and 
self-contained proof of the uniform continuity of J with respect to the initial 
data a. 

Theorem 4.1 The application J is uniformly continuous if all the spaces 
are equipped with the C° topology. Thus it extends to an uniformly contin- 
uous map, still denoted by J 

J : C^^T] x T*N) x C°(N) -» C°([0,T] x N). 

Proof. In [25] is proved that: 

||J(#i,<7) - J(H 2 ,a)\\ c o < T\\H! - H 2 \\ c o 

and the extension of J to Lipschitz Hamiltonians is largely discussed. Here 
we investigate on the following estimate involving the initial data: 

\\J{H,o- l )-J(H,a 2 )\\c° < Iki -a 2 || c o. 

For i = 1, 2, let T ai , L Gi and Si be respectively the initial data submanifold, 
the geometric solution and the corresponding GFQI related to the initial 
datum cij. Moreover, since the geometric solution -see Proposition 13.21 - is 
Hamiltonian isotopic to the zero section O = Ot*(\o,t]xN) of T*([0, T] x N), 
we denote by p\ and p 2 the time-one map such that 

L ai = |J $ t (T ai ) = p 1 (0), L U2 = y $ t (T a2 )=p 2 (0). (16) 

0<t<T 0<t<T 

Hence, as a consequence of Proposition 13.51 we have: 

\\J(H,ai)-J(H,a 2 )\\ C o < j(L ai ,L a2 ) = j(p l op 2 1 (L r7 . 2 ),L (72 ) < ^(pio^ 1 ). 

In order to estimate ^(piop" 1 ), we proceed into two steps. We first explicitly 
construct a Hamiltonian isotopy (^ r s )se[o,i] °f r*(K x N) with the following 
two properties: 

*i(r 01 ) = r oa) 7(*i) < -o- 2 \\ C o. 
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Secondly, we prove that 7(^1 o p 2 ) = 7(^1). 
For i = 1,2, let us consider the submanifold: 

r° i =r (T .n{r = 0} = {(0,x,0 1 dr i (ar)) : x € N}. 

In order to move T ai into r CT2 , we start observing that r° can be easily 
moved into by using the time-one flow of the Hamiltonian: 

K(t,x,T,p) = (Tx(x) - a 2 (x). 

Therefore, it only remains to move r CT1 into r° and into T U2 and this can 
be achieved by employing C° arbitrary small Hamiltonians. In particular, 
given a function g(t) G C 1 ([0,T\) with g(0) = and g'(0) = 1 (we will 
choose HpIIco << 1 below), the time-one flow of the Hamiltonian: 

K\(t,x, t, p) = -g(t)H(0,x,dai(x)) 

moves F ai into r° and the time-one flow of the Hamiltonian: 

K 2 (t,x,T,p) := g(t)H(0,x,da 2 (x)) 

moves r° 2 into T a2 . Hence, the required Hamiltonian isotopy ( x E f s ) se [ 0: i] 
is the composition of the three Hamiltonian flows constructed just above. 
Using now the triangle inequality for the function 7 (see Proposition 12. 6p 
and the estimate given in Proposition 12.71 and since ||<?||c?o is arbitrary small, 
we conclude that 7(^1) < ||o"i — o^Hc - 

Here below we show that ||pi op 2 1 \\ c o = \\^/i\\ c o. From the one hand, taking 
into account (fT6j) : 

L ai = P i(0) = p 1 op- 1 (L a2 ) 

= Pl°Pj 1 ( U ^(r CT2 ) = IJ pxop- l o<S> t {T a2 ). 
\0<t<T J 0<t<T 

From the other hand, since ^i(T ai ) = T a2 : 

0<t<T 0<t<T 

Therefore, Vt G [0,T]: 

Pl o P - l o^ t (r CT2 ) = $ i o^- 1 (r (J2 ), 

implying that: 

o Pl o p- 1 $ t (r CT2 ) = ^ 1 (r. 



Moreover, from the very construction of ^1 we obtain that the same property 
holds for the Lagrangian submanifold of T*([0,T] x N): 

A := {(0,x,e - H(0,x,da 2 (x)),da 2 (x)) : x G N, e G R}, 
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that is 

o Pl o p 2 1 o $ t (A) = r/ 1 (A) . 

Therefore, keeping in mind the invariance by conjugation and inverse of 7 
(see Proposition I2.6p . we conclude that Vt € [0, T\: 



7(*t 1 Pi P2 1 = 7(P1 P 2 = 7(^1 X ) = 7(^i) < Iki - c-2||c°) 
and the required estimate is proved. □ 

Previous theorem allows us to consider Cauchy problems with weakly 
regular initial data. In fact, for only continuous functions <r, the above 
-see @- initial data submanifold T a cannot be defined anymore and conse- 
quently the standard procedure to obtain the geometric solution L and the 
related variational solution u does not work. However, every continuous ini- 
tial datum a G C°(N) can be approximated in the uniform convergence by a 
sequence of differentiable functions o~ n € C 1 (N) , for which we construct the 
related variational solution J(H,a n ) = u an . As a consequence of the conti- 
nuity of J, it is easy to prove by direct computation that i) u an is a Cauchy 
sequence -therefore it converges on the complete space C°([0, T] x N)— and 
ii) its limit does not depend on the chosen approximating sequence a n . 
These arguments justify the next 

Definition 4.2 (C° -variational solution) Given a continuous initial datum 
a € C°(N), the C° -variational solution for the Cauchy problem is the 
unique function u a G C°([0, T] x N) such that, for any arbitrary C 1 approx- 
imating sequence o~ n : 

C\N)3a n -^aeC°(N), 
with related ^^-variational solutions J(H,o~ n ) = u an , we have that 

lim \\u an - uAqo =0 on [0,21 x N. (17) 

n— >+oo 

Since the beginning of the Eighties of the past century, it is present 
in literature a rather fruitful weak notion of solution for Hamilton-Jacobi 
equations with continuous initial data, namely, the viscosity solution. We 
refer to |20j . [5] and [3] for a detailed review on the subject. 

Definition 4.3 A function u € C((0, T) x N) is a viscosity subsolution 
[supersolution] of 

du du 

— (t,x) + H(t,x,—(t,x)) = (18) 
if for any<i>eC x ( l ®,T)Y.N), 

^(t, x) + H(t, x, ^(t, x))<0 [> 0] (19) 
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at any local maximum [minimum] point (t, x) € (0, T) x N of u — (j). Finally, 
u is a viscosity solution of \18\) if it is simultaneously a viscosity subsolution 
and supersolution. 

The two notions of solution have the same analytic properties, that is, theo- 
rems of existence and uniqueness do hold, see [25| . It is also remarkable that 
the Definition \^2\ of C°-variational solution is consistent with the well-known 
C°-stability (for which we refer to [20]) of viscosity solutions. Variational 
and viscous solutions coincide when the Hamiltonian is p-convex, see [16] . 
A detailed proof of this fact in the case H(x,p) = ^\p\ 2 + V(x), x G T k , 
is also given in [7] using the Lax-Oleinik representation formula. However, 
we do not know in literature examples showing the splitting between min- 
max and viscosity solutions: a task of the next section is to construct an 
explicit evolutive example marking the separation between the two notions 
of solution. 

4.1 Splitting between minmax and viscosity solutions: an 
evolutive example 

In the paper [21], starting from the non-convex Hamiltonian 

H(x,p) = p — p 3 — x, 

it is explicitly shown that the minmax selection from the GFQI of a La- 
grangian submanifold contained in -£f _1 (0) cannot be a subsolution for the 
corresponding non-evolutive equation. The evolution setting for the same 
Hamiltonian displays some intriguing aspects connected to the choice of the 
initial data, e.g. the Cauchy problem: 

+ (g(i,*)) S -* = 

(20) 

^u(0, x) = a(x) = 

admits a global classical solution (which is both the variational and the 
viscous one) and does not display any separation between the two notions 
of solution. Nevertheless, drawing on the above non-evolutive case, we ex- 
plicitly construct an evolutive example where minmax and viscous solutions 
actually differ. 

Alternatively to the problem (|20p . we consider non- vanishing initial im- 
pulses da(x) = v(x) such that, for fixed e > 0: 

the positive solution of v — v 3 — x = if x < — e 

v(x) = < the negative solution of v — v 3 — x = ifx>e 

any monotone smooth joint of the above branches if |x| < — e 
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and we investigate on the solution u(t, x) for the initial datum u(0, x) = a{x). 
Hamilton's equations related to 7i(t, x, T,p) = t + p — p 3 — x are 

( ■ 

t = 1 

X=1 - 3P2 (21) 
r = 

p = 1 

Focusing on |xo| > e, the corresponding initial data submanifold is given by 
r a,\x \>e = {(0,x , -H(x , da(x )), da(x )) : \x \ > e} 

= {(0,x ,0,v(x o )) : \x \ > e} . 
Since the flow $ H reads 

(x{t) = x + t- 3v 2 {x )t - 3v{x )t 2 - t 3 (22) 
\p(t) = v(x ) + t, 

starting from |xo| > £ and taking into account the very property of the 
function v[xq) again, we obtain 

(x{t) = v{x ) + t-{v{x )+tf 
\p{t) = v{x ) + t 

so that the corresponding geometric solution equals 

L \x \>e= IJ {{t,v(x ) +t - (v(x ) +tf,0,v(x ) +t) : \x \>£}. 

0<t<T 

(23) 

A simple recognition of (|22p i shows that the x-components of the charac- 
teristics starting from \xq\ < e remain definitively away from for t > 
big enough. As a consequence, locally to x = and for t > sufficiently 
large, the geometric solution corresponds just to (|23[) , There, the Lagrangian 
submanifold is three-valued and it is locally described by the GFQI 

S(t, x;0 = \t 2 +tti-l(Z-x + t)l + U 2 . (24) 

Due to the presence of the leading term ^£ 2 , the minmax procedure for 
S(t,x;£) selects the minimum value over the parameters £. More precisely, 
from the condition 

d S 

-Q7(t,x;0 =£ + t-(t-x + t)3 =0, 

or equivalently (£ + t) — (£ + 1) 3 — x = 0, we obtain directly that the corre- 
sponding minmax solution u(t, x) assumes the following analytic form. 
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For x < 0, let us denote by v + (x) the unique positive root of the cubic 
polynomial v — v 3 — x. Then we have that: 

u(t, x) = S(t, x; v + (x) — t) 

1 3 4 1 

= ^ + {x) - tf + t(v + (x) - 1) - j(v + (x) -x)»+ -t 2 . 
For x > 0, if we indicate by v ~ (x) the unique negative root of v — v 3 — x = 0, 

u(t, x) = S(t, x; v~ (x) — t) 

= \{v-(x) - t) 2 + t(v-(x) - t) - - A {v~{x) - x)l + h 2 . 

Finally, it can be verified directly that the minimum u(t, 0) = — -r is attained 
for the values 1 — t and — 1 — t of the parameter £. From the derivatives 

dS , _ s ,i dS . ,i 

— (t,x; -x + t)s +t, fc&vO = (£-x + t)3, 

we obtain that the function u(t, x) results non-differentiable in the points 
(t, 0), with corresponding superdifferential D + u(t,0) = {0} x [—1,1] and 
sub differential D~u(t,0) = 0. 

By standard arguments -see [3]- we conclude that, at any point (t, 0) as 
above, the function u(t, x) cannot be a viscosity solution to the evolutive 
Hamilton-Jacobi equation d20j) x . In fact, taking e.g. the value (0, "^7^) € 

D + u(t, 0) and since H(0, -4=) = —j= > 0, the subsolution property fails. 



5 The Markovian property 

The enlargement of the notion of variational solution to continuous initial 
data turns out crucial in order to deal with the Markovian property for such 
solutions, which can be explained as follows. 

Let H be a fixed C 1 ' Hamiltonian and / a continuous initial datum. 
Let denote by u E C°([0, T] x N) the variational solution (related to the 
refined Definition 14. 2p with datum / at time t\ G [0, T]: 

r ^(t,x) + H(t,x,^{t,x)) = 

(25) 

u(h,x) = f(x) 

Equivalently, the above solution u(t, x) is described by the following map 
J*'* 1 : 

jMi . C °(N) ^ C°(N), /(•) ^ (/)(•) := u(t, ■), (26) 
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where t G [0,T]. The Markovian (or semigroup) property is one of the main 
features of the viscosity solutions; it means that: 

jH,t 2 Q jt 2 ,h ^ = jH,tj ^ ( 27 j 

VO < t\ < t2 < t$ < T and Vex G C (N). A general treatment of the non- 
linear semigroup associated to a first-order Hamilton-Jacobi equation with 
uniformly continuous initial data is developed in [21J and [22] for viscosity 
solutions. 

This is not the case of variational solutions: Viterbo and Ottolenghi in [25] 
(see also [32J) suggest that the failure of this property can be marked by a 
sort of "hysteresis phenomena". In the next proposition, we show that for 
the variational solutions a natural mathematical notion of non-hysteresis 
-see (|28l) - is actually forcing the stronger group property. 

Proposition 5.1 Let H G C^QC^T] x T*N). The C° -variational solution 
does not exhibit hysteresis, that is 

jtify jte-^cr) = (j (non-hysteresis) (28) 

V£i,t2 £ [0>^1 an d ^ C°(N), if and only if the group property holds: 

jtsto Q jt2,h( a j = j*3,ti( (T ) ) (29) 

Vti,t2,t 3 €[0,T\ andVa eC°{N). 

Proof. We have to prove only the sufficiency of the condition (|28p . the 
necessity is in fact immediate. Let u G C°([0,T] x N) be the variational 
solution to the Cauchy problem: 

'%(t,x)+H(t,x,%(t,x))=0 

< 

u{t\,x) = a{x) 

and /(•) := u(t2,-) G C (N). We consider an arbitrary C 1 approximating 

sequence / n — ► /, generating the C ' -variational solutions u/ n on [0, T}x N 
with Uf n (t2,-) = /n(")- Under the Definition I4.2I the variational solution 
G C°([0,T] x 2V) to the Cauchy problem starting from Uf(t2, •) = /(•) is 
given by: 

lim \\uf — Uf || co = 0, (30) 

n— >+oo 

and Uf(ts, •) is exactly: 

u/(*3,0 = ^ t3 ' t2 ° ^ 2,tl (^(-)- (31) 
We proceed by introducing 
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with related C 0,1 -variational solution U£ n . 

Since f n is convergent and J* 1 -* 2 is continuous, the sequence S n is convergent 
and, as a consequence of the non-hysteresis assumption (f28j) . S n — > a does 



hold. Moreover, as by construction both us n and Uf n produce the solution 
to the Cauchy problem: 

u(t 2 ,x) = f n (x) 

by uniqueness, we conclude that U£ n = Uf n on [0, T] x N. 

For every S n G C 0,1 (iV), we take now a C 1 regularizing sequence £ n>m — > S n 
and we determine J* 3 '* 1 (o")(-) by utilizing the (diagonal) sequence: 

— v c ° 

with corresponding C 0,1 -variational solutions u an . Under the Definition 14.21 
the variational solution u a e C°([0,T] x N) is given by: 

lim \\u an -u a \\ c o = 0, (32) 
n— >+oo 

and u a (t3, •) is exactly: 

tWa.O = J' 3 '*»(")- (33) 

However, from 

IKn ~ U f\\c° < IK„ -«eJ|c° + ll«E„ - U fn\\c° + ||«/n -«/||c°i 

and by using (j30j) and the fact that ii£ n = Uf n on [0, T] x N, we achieve that 

lim IK„ - U/Hoo = °- ( 34 ) 

As a consequence, compare (fHU]) . (f3"2"j) and (|3"4"|) . iij and coincide on [0, T] x 
iV and for t = t 3 we obtain (EHJ). □ 

6 Markovian variational solutions 

The above weak Definition 14.21 is substantially based on the construction of 
converging sequences of minmax solutions: 

C° 

where C l (T k ) 3 a n —>■ a £ C°(T k ). We remind that, for a smooth (i.e. 
at least C 1 ) initial datum, explicit formulas for variational solutions pass 
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through the construction of the finite parameters GFQI globally describing 
the corresponding geometric solution (see (jlip ): the general procedure is 
based on a finite reduction of the Hamilton-Helmholtz functional, which 
can be performed by the "broken geodesies" method of Chaperon (see 
|12j and also [27]) or, alternatively, by an Amann-Conley-Zehnder reduction 
procedure, see for example PQ and [9]. 

In the Appendix -substantially following the line of thought of Chaperon- we 
resume such a construction in a rather general case, that is for Hamiltonians 
H(t,x,p) G C 2 ([0,T] x T*T k ) of the form: 

H(t,x,p) = -(Ap,p) + V(t,x,p), (35) 

where A 1 = A, det(A) ^ and V(t, x,p) is compactly supported in the p 
variables. 

We assume the global existence of the Legendre transformation: 

(*) the map p i— > D p H(t, x,p) provides a global diffeomorphism of M k into 
itself, uniformly Lipschitz with its inverse. 

The previous condition is in particular satisfied when H(t,x,p) is p-convex: 

3c>0: (D%H(t,x,p)\,\) > c\X\ 2 , (36) 

VA G R k , V(t,x,p) G [0,T] x T*T k . However, it includes also a large class 
of non-convex cases: for instance H(p) = h(Ap,p) with general hyperbolic 
matrices A. 

We refer to the Appendix for the proof of the next result. 

Theorem 6.1 Let H(t,x,p) G C 2 ([0,T] xT*T fc ) be a Hamiltonian function 
of the form a ™ d ° G C l (Y k ). 

We suppose H(t,x,p) satisfying condition (*) and we denote by Sq(X,x; U), 
U G M. Nk , the generating function for the flow (jf^ : (X,P) i— > (x,p). 
Then the (broken geodesies) generating function 

S\x;tU) -aiO + Sl^x-U) (37) 

for the Lagrangian wavefront 4> 1 ^ \lm(da)) is quadratic at infinity, with quadratic 
form given by the nondegenerate (N + l)k x (N + l)k matrix: 





(A 





A = 


'•• 







\o 


A 



As a consequence, in the hypothesis of the previous theorem, we conclude 
that the variational solution u(t,x) is generated by a cohomology class of 
degree given by the Morse index of the quadratic form ^(Ap,p) involved in 



18 



6.1 The convex case 

This section is devoted to detect the Markovian property for p-convex Hamil- 
tonians. We emphasize that the proof is given by solely using minmax tech- 
niques. 

Proposition 6.2 Let H(t,x,p) G C 2 ([0,T] x T*T k ) be p-convex. The cor- 
responding C° -variational solution is Markovian: 

VO < h < t 2 < t 3 < T and Vct G C°(T k ). 

Proof. Through the proof, we indicate by 5* the GFQI for the Hamiltonian 

flow (jf^ . For an arbitrary C 1 regularizing sequence a n —> a, let (see (|37p 
and (US}): 

a n (t, x) = mm[a n (0 + (£, x; U)}, t G [h, T] (38) 

and indicate by a G C°([ii, T] x N) the corresponding C°-variational solution 
on[t!,T]: 

lim \\a n - a\\ C o = on [ti,T] x N, (39) 
so that J i2 ' 4l (cr)(-) = a(t 2 ,-)- 

In order to construct J* 3 '* 2 o J* 2 '* 1 (<r)(-), let us denote by 

/„(•) ^ a(*2, (40) 
an arbitrary approximating sequence, and 

ln (t,x) = min [/„(£!) (6, *;£/i)], t G [t 2 ,T]. (41) 
(fi>Ui) 

Therefore, the variational solution 7 G C°([t2, 7 1 ] x iV) to the Cauchy problem 
starting from 7^2, •) = ct{t 2 , •) is given by: 

lim \\j n - j\\ c o =0 on [t 2 ,T] x iV, 
and 7^3, •) = J* 3 '* 2 o J* 2 ' il (cr)(-). 

Taking into account and (|38|) . we detail now j n (t,x): 
Jn(t,x)= min [/„(&) +5£,(£i,a;;E/i)] 

= min [/ n (6) + £t 2 (£i,x;[/i) - a n (t 2 , 6) + "nfe, 6)] 
fn (6) + $ 2 (6, x; U x ) - a n (t 2 , 6) + min [<7 n (£) + S^, fr; £/)] 



= min 

(CM 
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= min [a n (0 + /„ (&) - a n (t 2 , 6) + S*J (£, ft; C/) + S\ 2 x; E>i)] 

(42) 

= min [a n (0 + (S n &)(£, x;^, Z7i, £/)] , 

where (SVi)^ involves all the above terms but o~ n . We claim that: 
hm 11(^-^1^0=0 on [t 2 ,T]xN. 

n— >+oc 

In fact, in view of the composition rule for generating functions (cfr. Lemma 
Oin the Appendix), (£,£i;U) + S\ 2 (£i,x;£/i) in g2J generates ^ 
for t > £ 2 , and the convergence follows from (|40|) . Consequently, see also 
Proposition III in |25j : 

lim || 7n - a n || c o =0 on [t 2 ,T] x N. (43) 

Therefore, from 

Win ~ a\\c° < Il7n - "nib + ll«n ~ a llc*° 

and by using (|43p and (|39p , we achieve that a = 7 on [£2 , 7 1 ] and for t = £3 
we obtain the thesis. □ 

The proof of the previous proposition prompts generalizations towards some 
non-convex cases, which will be discussed here below. 

6.2 The convex-concave case 

Let j be an integer, < j < k, and for any (x,p) G T*T k set: 

x = (xi,x 2 ) G T j x T k ~\ p = (p!,p 2 ) G M j x R k ~* 
and assume: 

H(t,x,p) =H x (t, xi, Pi) + F 2 (£,x 2 ,p 2 ) GC 2 ([0,T] xrf), (44) 

where i?i(£, xi,pi) is p-convex and -ff 2 (t, x 2 ,p 2 ) is p-concave. In this section, 
we denote by (Si)q and (£2)0 the generating functions for and <^>^ 
respectively. 

We first suppose that the initial datum a G C 1 (T k ) is of the form: 

a{x) = o\{x\) + cr 2 (x 2 ), (45) 
and we prove the following 

Proposition 6.3 T/ie variational solution u(t, x) to the Hamilton- Jacobi 
equation with Hamiltonian ft44\ ) an d initial datum |^5| j is given for all (t, x) G 
[0, T] x T k by: 

u(t,x) = min [ai(6) + (5i)* (ei,xi;Z7i)]+ max [<t 2 (&) + (S , 2 )o(6, x 2 ; tf 2 )] 
(£1^1) (£2,^2) 

(46) 
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Proof. The Lagrangian wavefronts (Im(dcri)) and <j) t ^ (Im(do~2)) admit 
the GFQI: 

S l (t,x l ;^ l ,U 1 ) := a x (&) + (S^ (£ x , x x ; C/i) 

and 

«S 2 (t,z 2 ;£ 2 ,t/ 2 ) := ^(£2) + (S 2 )£(£ 2 ,x 2 ;[/ 2 ), 

with positive and negative defined quadratic form respectively (see Theorem 
I6.ip . Moreover, since H and a separate the variables x\ and x 2 , </>^ (im(ci<7)) 
is generated by the GFQI with parameters (£, {/) = (£i,£ 2 , fj, t/ 2 ): 

S(i,x;£,£/) :=5i(t,xi;^i,i7i) + <S 2 (t,x 2 ;6,^ 2 ) (47) 

and related quadratic form Q(£, £/) = (£f + Uf ) - (£f + f/f ). 
Let c > be large enough so that the corresponding sublevel sets 5 ±c are 
respectively connected and unconnected. Keeping in mind that the minmax 
critical value u(t, x) marks a metamorphosis of the topology of the sublevel 
sets for <S, we proceed by giving upper and lower bounds for u(t,x). 
From the one hand, by decreasing A < c, as long as the sublevel set S x , 
given by 

+ (£1)0 (£1, £i; U{) + <t 2 (£ 2 ) + (S 2 )o(£ 2j x 2 ; U 2 ) < A (48) 

remains connected, for all (£ 2 , U 2 ) there exists at least one (£1, U\) such that 
the inequality (l4*8j) is satisfied. In particular, there exists (£1, U\) such that 

o-x(Ci) + (Sx) t (Ci,xx;U 1 )+ max [<r 2 (£ 2 ) + (S 2 % (£ 2 , x 2 ; U 2 )] < A. 
Therefore: 

u(t,x) < min [^(£1) + {Sx) t (Zx,x 1 ;Ux)]+ max [<x 2 (£ 2 ) + (5 2 )* (£ 2 , x 2 ; U 2 )] . 

(49) 

From the other hand, by increasing A > — c, as long as the sublevel set S x 
is unconnected, there exists (£ 2 ,£/ 2 ) such that for all (£i,f7i) the previous 
inequality (JMJ) is unsatisfied. In particular, it exists (£ 2 ,?7 2 ) such that 

min [^(6) + (S r 1 )*(£ 1) x 1 ;C/ 1 )] +a 2 (£ 2 ) + (S 2 f ^ 2 ,x 2 ;U 2 ) > A, 
and consequently: 

u(i,x) > min [ax^i) + (5 1 )*(£i,x 1 ;[/!)]+ max [ct 2 (£ 2 ) + (S 2 )* (£ 2 , x 2 ; U 2 )] . 

(50) 

From the estimates (|49|) and (|5Up . we obtain the thesis. □ 
As a consequence of the explicit formula (|46p . the variational solution to 
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the Hamilton-Jacobi equation with convex-concave Hamiltonian (144ft and 
initial datum (|45p results Markovian. In fact, since ()46p is the superimposi- 
tion of the solutions to the Cauchy problems: 



^(t,x) + H l (t,x i ,^(t,x l )) = 
u(0,Xi) = ai(xi) 

i = 1,2, the arguments of the proof of Proposition 16.21 still hold. 

We conclude this section by considering a generic initial datum, that is 
not split up in the form (|45H . The Lagrangian wavefront </>^° (Im(da)) is now 
generated by: 

S(t, x; £, U) := 6) + (Si^i, si; C7i) + {S 2 )l(£ 2 ,x 2 ; U 2 ). (51) 

In such a case, the same arguments on the topology of the sublevel sets used 
in the proof of Proposition 16.31 lead to the following explicit pointwise upper 
and lower bounds for the corresponding variational solution. 

Proposition 6.4 The variational solution u(t, x) to the Hamilton-Jacobi 
equation with Hamiltonian and continuous initial datum a £ C 1 (T fc ) 
satisfy for all (t, x) € [0, T] x T k 

max min \S(t, x: £ , £7)1 < u(t, x) < min max \S(t, x: £, U)] , (52) 

(&,i/a) (tuny (ei,c/i)(6,c/ 2 ) L 

where S(t,x;£,U) is given by 157]) . 

The previous proposition restores in a genuine minmax framework a rather 
general Hopf-type estimate and gives a representation formula for the varia- 
tional solution whenever the first and the last terms are equal. This trivially 
occurs for j = k or j = 0, in such a case u(t, x) reduces to the formulas (fT3j) 
and (fT4"|) respectively. A more interesting case has been just discussed in 
Proposition | 



Remark Similar Hopf-type estimates hold for viscosity solutions, see [4J and 
[2]. In particular, the paper [3] treats the case of a strictly integrable convex- 
concave Hamiltonian H(p) = H\{pi) + H 2 (p2) and presents (fl6"|) and (|52l) for 
viscosity solutions. Therefore, the Proposition 16. 31 establishes definitively the 
coincidence for variational and viscous solutions to Hamilton-Jacobi prob- 
lems for convex-concave Hamiltonians H(p) and initial data separating the 
variables. However, we stress that the present estimates (j52H for variational 
solutions do hold for a larger class of Hamiltonians, possibly depending on 
(t,x). We finally note that the papers [3] and [2] also present upper and 
lower bounds for viscosity solutions in the case where the convex-concave 
assumptions are not on the Hamiltonian function but on the initial datum: 
this is consistent with the viscosity solutions theory, which does not operate 
necessarily with compactly supported initial data and GFQI. 
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7 Appendix: Construction of global GFQI 

For the large class of Hamiltonians H(t,x,p) = \(Ap,p) + V(t,x,p) intro- 
duced in Section El here we explicitly construct the finite parameters GFQI 
globally describing the geometric solution L. 

Denoting by H t (x,p) = H(t,x,p), we lift H t (x,p) to the covering space 
[0, T] x M 2fe and indicate the components of its flow by (x* ,p*) := (^^(X, P). 
The following proposition is a consequence of the above assumptions (*) on 
H t (x,p) (see also Proposition 2.3.3 in [12]). 

Proposition 7.1 It exists e > small enough so that every application: 

hi : (X, P) i-» (X, x*), < \t - s\ < e (53) 
is a Lipschitz diffeomorphism ofM. 2k . 

Proof. Note that (I53p is degenerate for s = t. To overcome this fact, we use 
Chaperon's trick by introducing the following isomorphism: 

L*(X,x) := (x,^ 
\ t — s 

and we equivalently prove the assertion for k\ := L s o h s . The application 
fc* is well-defined also for t = s. In fact, Hamilton's equations gives: 

kl(X, P) = (x, J- J* D p H T ((j) T s (X, P))dA , (54) 

and therefore kg(X, P) = (X, D p H s (X, P)), which is, precisely, the Legendre 
transformation. Conditions on Ht(x,p) guarantee us that kg is a Lipschitz 
diffeomorphism for every s G [0, T] and that the Lipschitz constants of kg 
and (kg) -1 are bounded independently of s. We estimate now the Lipschitz 
constant of k s — kg. We have: 

(kl - k s s )(X + x,P + p)-(k t s - k s s )(X, P) = 
= (o, j^— s [D p H T (4>l(X + x,P + p))- D p H T (X + x,P + p)] dr 

0, j^- g J [D p H T {4>l(X, P)) - D P H T (X, P)] dr^j -> (0, 0) 
for t — > s. Moreover: 

|| (D P H T o f s - DpH T ) (X + x,P + p)- (D P H T o ft - D p H T ) (X, P)\\ Rk < 

< U V (D P H T ) U T g(X + x,P + p)-<p T g(X,P)\\ R2k +Up(DpH T ) \\(x,p)\\ R2k < 
< (Lip (D p H T ) Lip(#) + Lip (DpH s )) ||(x,p)|| R2fc , 
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where, in our hypothesis, the Lipschitz constants appearing in the last mem- 
ber are uniformly bounded with respect to s and r in [0, T\. As a conse- 
quence, it results that Lip(/c* — k s s ) — > for t — > s, uniformly with respect 
to s. Hence, it exists e > such that 

Lip(Id - kt o (fc|)-i) = Lip((A£ - kl) o (fc|)-i) < 

< Lip(A£ - k* a ) sup ^((fcf)- 1 ) < 1 
se[o,T] 

for < |t — s| < e. It is now well-known that contractible perturbations of 
the identity (that is, Id— u where Lip(u) < 1) are Lipschitz diffeomorphisms. 
Applying this result to u = (Id — fc* o (/of)" 1 ), we obtain that the application 
Id — u = k f s o (kg)~ x is a Lipschitz diffeomorphism; and the same is true for 
kl □ 

As a consequence, quoting for example [23] and [E], the flow: 

<j ) % s :(X,P)^(x t s ,p t s ), 

< \t — s\ < e, provides a symplectic twist diffeomorphism. In the sequel, 
we alternatively use the expression symplectic diffeomorphism and canonical 
transformation. 

Fixed t E [0, T], we divide the interval [0, t] in an appropriate number 
N + 1 of sub- intervals [tj,tj + i], < j < N, of length e = j^j'- 



= t < ... < t N+1 =t, N € N 

and we define 

(X j+1 ,P j+1 ): J n J (X,. !>/). (55) 

As a consequence of the previous proposition, it exists N large enough such 
that every application: (Xj,Pj) i— > (Xj,Xj+i) is a global diffeomorphism of 
M. 2k . Hence, one can obtain the explicit expression for Py. 



and accordingly use the variables (Xj,Xj + i) in order to describe the canon- 
ical transformation given by the flow (j) t ^ +1 ' tj . The fact that the map 4> t ^ +1 ' tj 
is symplectic and the triviality of the deRham cohomology group H 1 (M 2k ) = 
{0} imply the existence of a generating function S t j+1 (Xj , Xj + i) such that: 



H - ~ dx~ \ I A i > A i+i J 



(56) 
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Moreover, S^ +1 comes essentially from the Hamilton-Helmoltz functional: 

£ +1 [j>l (X^Pj) ±-x\. (X^Pj) - H T (f£ (X^Pj)^ dr 

(57) 

see [T2J for a detailed proof of this fact. 

The Hamilton principle function relative to the canonical transforma- 
tion given by the flow (jf^ can now be easily computed by using the next 
version of a popular composition rule for generating functions of canonical 
transformations (see for example [IT], [18] and [6]). 

Lemma 7.2 Let 

cf>:(Q,P)^(q,p), i;:(X,Y)^(x,y) 

be two canonical transformations generated respectively by S(Q, q) and F(X, x). 
Then the canonical transformation 

i> ° 4> ■ (Q,p) ^ (x,y) 

is generated by 

G(Q,x;w):=S(Q,w)+F(w,x). (58) 

Proof. It is sufficient to write down the relations for G(Q, x;w): P = — §f^j, 



Proposition 7.3 Let (X,x) := (X ,X N+1 ) and U := (X,-)i<j<iv £ R Nk . 
The canonical transformation given by the flow 

</>f:(X,P)^(x,p) 

is generated by 

N 

-it 



Sl(X,x;U) :=^4 +1 (X„X J+1 ). (59) 
i=o 

In other words, the graph of (jf^ is the set of points: 
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Theorem 16.11 in Section [6] is now a straightforward consequence of the pre- 
vious proposition. 

Proof of Theorem \6.1l A simple direct computation -in particular, the 
stationarization with respect to £ connecting the impulses of Im(da) with 
the starting impulses of </>#°- proves that the function S t (x;^,U) := cr(£) + 
Sq(£,x;U) generates the Lagrangian submanifold (p^ (lm(da)) . We check 
below the quadraticity at infinity property of S t (x; £, U) with respect to the 
parameters (£, U): this is a crucial step in order to catch the minmax critical 
point in the Lusternik-Schnirelman format. 

Using the notation (Xj+i, Pj+i) = <Ph +1 ' 3 { x j->Pj)i we refer to a partition 
of the interval [0, t], = to < . . . < ijv+i = t and tj+\ — tj = e, so that 
every application (Xj,Pj) t— > (Xj,Xj + \) is a global diffeomorphism of M. 2k 
and ([56]) holds. Since V(t,x,p) is compactly supported in the p variables, 
we have that H(t,x,p) = ^(Ap,p) for p outside a compact set. As a con- 
sequence, we can assume that, up to the three main operations described 
in Section El every generating function S t J+1 (Xj, Xj + \) coincides, for large 
.. A-ipQ+x-X,-) ,, 

II £ llR fc ! 10 

s tj +1 ( x jiXj + i) = — - Xj), (X j+ i - Xj)y 

In fact, we obtain: 

P 3 = ~mcJ S t 3 J +1 ( x ji X j+i) = jA^ 1 (X j+1 - Xj) 

< 

= m^ s 4 +1 ( x h x j+^) = i A ~ 1 i x o+^ - x i) 

that is, Pj+i = Pj = ±A~ 1 (X j+1 - Xj) and X j+1 = Xj + eAPj. We apply 
now proposition I7.3t denoting (£,x) := (Xq, Xjv+i) and U = (Xj)i<j<N, 
we have that 



N 

S\x; £, U) = a(0 + S*(£, x; U) = a(X ) + ^ S^ +1 (Xj,X j+1 ). 

3=0 

Finally, by introducing the following change of variables: 
i 3 := A- 1 (X j+1 - Xj) for < j < N, 



the resulting function: 



/ N \ N 

S t (x;(t; j )o< j <N)=v\x-J2 A t3) + ^E< A &>&> ( 61 ) 
\ 3=0 J 3=0 
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is Z fe -periodic with respect to x and is quadratic at infinity, with nondegen- 
erate quadratic form given by: 

1 N 1 

Ye E<^>&> = Ye { ^ • • • ' eJv)A(Cl ' • • • ' iN)K (62) 

3=0 

□ 
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